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Abstract 

^ ' We present a numerical study of the non-equilibrium dynamics of the 

Sherrington-Kirkpatrick model. We analize the overlap distribution be- 
tween the configurations visited at the time t and in particular its scal- 
ing behaviour with the size of the system. We find two different non- 
. equilibrium dynamical regimes. The first is a proper Out of Equilibrium 

' Regime, that is the relevant regime for the dynamics of an infinite system. 

, The second is an Intermediate Regime that separates the Out of Equilib- 

rium Regime from equilibrium. After studying the crossover beetween the 
' two regimes, we focus on the Out of Equilibrium Regime and we reveal 

^ , some of the geometrical features of phase space. According to recent ana- 

I ' litical work, we find that the asymptotic out of equilibrium energy density 

' O ' is the equilibrium one. The same happens to the staggered-magnetisation, 

Ch , suggesting there is a deep geometrical similarity between equilibrium and 

O ■ out of equilibrium configurations. A procedure, that we call donation, 

shows that the dynamics follows sort of canyons, as opposed to a system 
of independent traps. 



■ 1 Introduction 



In the last years, the experimental, numerical and theoretical interest on the 
non-equilibrium properties of spin glasses ^ ^ has increased. Experiments 
have shown a very rich behaviour in many different materials (see for example 
[11 H ^ 01)' Some particular procedures have focused on measuring the main fea- 
ture of the slow spin glass dynamics: the aging phenomena. Simulations carried 
out on tridimentional spin glass models 1^ show some of the characteristics (slow 
dynamics, aging) seen in experiments, but suffer of a lack of a microscopic de- 
scription. A recent analitical work ^ on the mean-field Sherrington-Kirkpatrick 
model (SK) contribute to fill this gap, and confirm that spin-glasses represent 
a ground for developing non-equilibrium statistical mechanics. 

In the present work we study the Monte Carlo heath-bath dynamics (with 



Metropolis sequential updating algorithm) of the SK model |10 , defined by the 
Hamiltonian: ^ 

Hj[<7]= -^^Ji^cr.aj (1) 
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The Jij are random Gaussian variables with variance 1 / \/N. 

We test some recent anahtical predictions and get insight into the 

geometrical properties of the phase space interested by the dynamics. For this 
aim we use the technique of dynamics donation | p2| , that though experi- 

mentally unimplementable, is easy to implement numerically and give us insight 
in the nature of the dynamics. 

One of the main purposes of this paper is to study the range of validity of 
the analytical solution obtained in the thermodynamical limit {N — > oo) when 
the size of the system is finite (TV finite). We find the {N ,t) scalings to have a 
mean-field like Out of Equilibrium regime, an Intermediate regime and the final 
Equilibrium regime. 

This paper is organized as follows: In Section II we present the definitions 
of various quantities we study in this paper and we discuss different limiting 
procedures leading to equilibrium or out of equilibrium dynamics. Section III 
is devoted to the numerical results. Finally in Section IV we present our con- 
clusions. 

2 General Considerations 

Before reporting the results of the simulations, let us observe that during a 
simulation the measured quantity O always depends on the size of the system 
(the number of spins N) and on time (the number of Monte Carlo sweeps pre- 
ceeding the measuring time t). In the following we shall show this dependency 
explicitly: 0{N,t). The equilibrium value is given by the Asymptotic Limit 
(AL) limt^ooO{N,t) = 0{N). The thermodynamical analytical calculations 
give the equilibrium value for an infinite system, that is the Thermodynamical 
Limit (TL) of the equilibrium quantity: limAr— >oo 0(iV) = Oeq- So, if we are 
interested in the equilibrium properties of the system we have to consider the 
following ordered limit procedure: 

lim lim 0(N,t) = lim 0(N) = Oe„ 

Now let us consider the opposite order of the limits. If the system undergoes 
a phase transition, the TL can break the ergodicity of the phase space. In such a 
case, the AL of the TL may be different from the equilibrium thermodynamical 
value: 

lim lim 0(iV,<) = lim 0{t) = Oo.eg ^ Oe„ 

Some recent analytical works |]l5| , ^ deal with this opposite ordered limit pro- 
cedure to describe the out of equilibrium properties of spin glasses. We call the 
asymptotic dynamics of an infinite system, in the sense of this order of limits, 
the non-equilibrium dynamics. 

In a real simulation, we cannot perform neither AL nor the TL. We consider 
systems of growing size, and for each one we consider an equilibration time 
after which the system is equilibrated. The correct criterion for choosing the 
equilibration time is not so trivial, especially for systems like spin-glasses, that 
evolve extremely slowly as shown clearly by experiments. We can consider 
the spin-glass model equilibrated when the Two-Times Quantities 2TQ do not 
depend explicitly upon both times, but only upon the time difference (for brevity 
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Homogeneous Time Dependence). For example if we consider the Two-Times 
Auto-Correlation Function 

CNit,t') = <l/N J2 ^^itW^it') > (2) 
i=l,N 

we are sure that the system forgot the initial t — randomly chosen config- 
uration only when CN{t,t') — C^it ~ t'). Hereafter we follow the standard 
motation, indicating the thermal average (different noise realization, but fixed 
Jij) with < • >, and the sample average (different chosen Jy) with •. 

Unfortunately, the measurements of 2TQ are very computer time consum- 
ing, because we have to keep track of all previous configurations of the system. 
It would then be better use an equilibration criterion involving only One-Time 
Quantities ITQ. However, in a glassy system, a ITQ may reach the defini- 
tive asymptotic value, very near or equal to the equilibrium value, even when 
the system is very far from equilibrium and, for example, the Auto-Correlation 
Function is far from being Homogeneous in times. So just checking for the 
asymptotic value of a ITQ can lead to erroneous results. 

3 Numerical Simulations 

3.1 The Overlap as the geometrical Clock 

It is well known [Q that the SK model (|l|) undergoes a phase transition at 
Tc = 1. The order parameter is the Parisi q{x) function that is related to the 
overlap distribution function of the equilibrium states P(q): P{q) ~ (^f)^^ (For 
a recent numerical analysis, see [^). To monitor the order parameter, q{x), we 
measure the first non-zero momentum of the P{q) overlap distribution, that in 
the zero field case is: 

92 [N, t) = < [(1/iV) J2 ^^itMt)? > (3) 

1=1, JV 

i.e. the second momentum. Here (7i{t) and Ti{t) denote the configuration at time 
t of two realization of the dynamics (Jy fixed), with independent randomly 
chosen initial configurations and independent noise realization. Hereafter we 
shall call them replicas. 

The quantity q2 is used to determine the equilibration of the SK model 
for example in [T^ . Th ey use the relation = 1 — 2TE jl8| (where E = 
limjv^oo limf^oo[< H >/N] is the equilibrium energy density) to determine the 
times i < to to skip before attempting the equilibrium measure. On the contrary, 
in this work we are interested in the evolution before the equilibration. 

We check explicitly the hypothesis that 92 represents a good "clock" for the 
dynamics, as shown in Figj^. We concentrate much of our efforts studing this 
quantity before it reaches the equilibrium value and in particular its scaling 
behaviour respect to the size of the system. 

We simulate the dynamics of (72 {N, t) for several system sizes at fixed tem- 
perature. The value of q2{N,t = 0) is generally because the starting 
configuration for each replica is choosen randomly and independently. A dif- 
ferent choice for the starting value of 52 is not determinant for the subsequent 
dynamics, apart from approximately the first hundred steps. 
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Auto-Correlation Functions 





Figure 1: The Auto-Correlation Functions become time-homogeneous only 
when q2{N, t) (^) reaches its equilibrium value. In (A) the system is equilibrated, 
in (B) the system is out-of-equilibrium (the equilibrium value of q2{N,t) is 
greater then 0.3). The data refer to 200 different samples (i.e. 200 different 
chosen { j}). For each sample we use at least 10 replicas (see text) to measure 



4 



The dynamics of q2{N,t) is characterized by a monotonic growth towards 
the equihbrium value. We identify two non-equihbrium regimes, characterized 
by different scahng properties respect to the size of the system. 

I) Out of Equilibrium Regime. 

In the first regime, q2{N,t) scales as 1/iV, with the law 

(?2(iV,t)a (I/7V) Ht) 

In Fig.^ we show the universal quantity Nq2{N,t) vs. t for systems of 
different size. The temperature dependence is restricted to the propor- 
tionality constant. We call this regime the Out of Equilibrium Regime. In 
the gedanken- simulation of an infinite system (72 (^) would be constantly 
zero. 

II) Intermediate Regime. 

As the q2{N,t) reaches a sensible fraction of its equilibrium value, the 
scaling behaviour changes. We tried a fit for this scaling. For a fixed 
temperature, we plot the quantity q2{N ,t) / q'^'^ {N) vs. ln(t)/iV". Varying 
a, we looked for the collapse of the curves associated to systems of different 
size. In FigJ| is shown the result for T — 0.4Tc, that indicates a value 
a ~ 0.5. But the value of a is temperature dependent. For different 
temperatures we found values in the range between 1 and 1/3. We called 
this regime the Intermediate Regime. 

The cross-over between the two regimes is shown in Fig.^. We plot the 
quantity Nq2 (iV, t) that follows an universal curve (at fixed temperature) in the 
first regime. Larger systems depart from this curve later, since the cross-over 
time grows with the system size. We define the cross-over time as the time before 
the difference between the Nq2{N, t) and the universal curve limAr^oo Nq2{N, t) 
reaches a fixed toUerance value. In FigjH we show the cross-over time vs. the 
size of the system. We guess a linear behaviour. 

In Fig.|^ we show the response of the dynamical "clock" q2{N,T) to a "pos- 
itive" cycle of temperature. We rise the temperature to a still subcritical value 
for a period, after that we restore it to the initial value. The overall effect of 
the cycling procedure is that the system goes closer to the equilibrium, since 
the q2 {N, t) "clock" reaches a higher value than the one obtained, at the same 
time, in the absence of the temperature cycle. 

Such behaviour seems different from the experimental results reported by 
Hamman ct al. in where they see, for positive temperature cycles, a restart 
of the dynamics, i.e. a loose of memory of the evolution before the heat pulse. 

However let us note that the response of the system to the positive increase 
of the temperature is very different from the response to the decrease. 

3.2 Out of Equilibrium Regime 

As we are interested in the out-of-equilibrium dynamics of the model, in the 
sense of the ordered limit procedure AL after TL, we study the dynamics 
of some quantities in the first dynamical regime, i.e. the Out of Equilibrium 
Regime. 
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Nq2(N,t) vs. t 

T=0.2Tc N=64,...1920 
40.0 I ' — ' — — 




0.0 I ' — ' — ' — — 

1 10 100 1000 

t 



Figure 2: The "clock" q2{N,t) in the Out of Equilibrium Regime multiphcated 
by N for systems of different size. The data refer to a minimum of 10 repHcas 
for each of 200 samples. 
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Figure 3: In the Intermediate Regime q2{N,t) scales as l/N". Here we plot 
q2{N,t) vs. \n{t)/N"' for the value a = 0.5, the more appropriate for this 
temperature (T = 0.4Tc). 
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Nq2(N,t) vs. t 

T=0.5Tc N=32,...,1280 




Figure 4: Cross-over from the Out of Equilibrium regime to the Intermediate 
regime. The plot represents the quantity Nq2 {N, t) vs t for several systems of 
growing size. Note that the curves assciated to TV = 640 and = 1280 collapse, 
indicating that the two systems are still both in the Out of Equilibrium Regime 
for the whole time window. The curve for N = 1280 has been used as the 
limiting curve for the determination of the Cross-Over time. 
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Figure 5: Cross-Over time between the two non-equilibrium regimes vs the size 
of the system A''. The fit suggests a Hnear behaviour. 
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Figure 6: Response of the "clock" of the dynamics q2{N,t) to a cycle of temper- 
ature. In the inset we show the temperature vs the time t. We have performed 
a short heat pulse. 
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The Energy density of the system at time t is: 



E{N,t) ^ il/N)< H{t) > (4) 

The relaxational dynamics of the Energy density for the SK model has been 
extensively studied (for example in [ p^ ) . Here we want to focus into its asymp- 
totic value. To this aim, we reparametrize the energy density curve with respect 
to the dynamical "clock" 52 {N, t) , that indicates the equilibration level of the 
system at time t. 

The Figure shows the result of such reparametrization. The line is the 
equilibrium relation E — — /3/2(l — (72). The first two curves refer to systems 
that reach equilibrium at the end of the simulation. The others, with growing 
size, are farther from equilibrium, but closer to the energy density equilibrium 
value. A plausible proposal for the limiting curve associated to an infinite system 
is a step function that, starting from E = 0, q2 ~ 0, abruptely collapses to the 
constant value E = Eeq for q2 > 0. Besides it means that this ITQ does not 
represent a good choice for the determination of the equilibration time. 

Our results disagree with those by Scharnagl et al. in The results of 

their power law fit on the first 130 steps for the energy dynamics of an infinite 
system (they use an interesting new procedure to simulate the dynamics of 
infinite sized systems [^) indicate an asymptotic energy value Coo different 
from the equilibrium value for temperature below O.STc- 

On the contrary, we find that the system relaxes to its equilibrium energy 
density. To corroborate our result, we summarize here previously published 
results 0. 

Consider a\ the projection of the configuration vector ~d^{t) ~ {o'i(t)} on 
the set of eigen- vectors Tf (A) of the coupling matrix { Jy }. We measure the so 
called staggered magnetisation, i.e. 

5iv,t(A) = < (aA(i))2 > 

where u\{t) = J2i=i n Xi(Ji{t), {Xi} being the coordinates of the A-eigenvector 

of the coupling matrix (X]j=i n •^ij'^j ~ ^\)- 

The staggered magnetization is a distribution that contains a lot of infor- 
mations. In particular its first momentum is the energy density (Q), object of 
our previous discussion. More precisely: 

lim E{N,t) = - lim / Xp{X)gN,t{X)dX 

where p{X) is the well known semicircle distribution for the eigenvalue of the 
Jij random matrix |2^ . 

In Fig.|| we show the staggered-magnetization, multiplicated by the eigen- 
value semicircle distribution p(A), compared with the equilibrium curve |p3|| . We 
note a very fast convergence of the out of equilibrium staggered magnetization 
to the equilibrium curve, when the system is still very far from equilibrium (as 
revealed by the P{q) shown in the figure inset). 

The Auto-Correlation function (^) shows aging behaviour (see Fig.||), con- 
firming the weak ergodicity breaking hypothesis (p^,||9[|): 
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Figure 7: Energy density relaxation curve in function of the corresponding value 
of the "clock", i.e. E{N,t) vs q2{N,t). 
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Figure 8: Staggered magnetisation calculated at different non-equilibrium times 
(from ref. ) . In the inset wc show the overlap distribution for the same 
times. The full lines correspond to the prediction of the replica ansatz for the 
equilibrium. 



13 



lim C{tw,tw + t) = 

T — >00 



dT 

dC{t^,t) 



< V(fixed)i™ 
> V(fixed)i > 



Consider the fluctuations of the Auto- Correlation Functions: 



FN{t,t') = <{l/N ^^{t)(T,{t')~CN{t.t')f> (5) 

1 = 1, AT 

In the equilibrium case the fluctuations have a finite, extensive and not self- 
averaging value (see ) : 

lim lim Fjv(iu,, iu, + t) = q2 ~ ql 

where qn = J q"'P{q)dq is the n-th momentum of the equilibrium order param- 
eter P(q). 

Instead, in the Out of Equilibrium Regime such quantities scale to zero with 
the size of the system. To show this, we have integrated the fluctuations for 
several sized systems. In Fig.^ we show the results for different values of t^. 
We fit each curve with a power law Fn oc (the result is shown in the legend). 



3.3 donation Procedures 

To obtain a clearer picture of the geometrical landscape, where the out of equi- 
librium dynamics take pla ce, we perform a particular simulation procedure that 
we caU "donation" pj, hj pj. Since we are interested in the phace space region 
visited by the dynamics after a certain time ty^ , we proceed to let evolve a single 
system with the usual Monte Carlo dynamics, until such a time. At we create 
a number of copy of this system, i.e. systems exactly in the same configuration 
(we clone it). Subsequently we let them (the original and the clones) evolve 
independently, that is to say with the same Hamiltonian, but different noise 
realizations. 

These systems represent different possible histories of the first system, as if it 
had met, in its Monte Carlo dynamics, a different random number sequence after 
the time tw There is a difference between these copies (clones) of the system 
and the previously defined replicas. The replicas start at time t ~ from 
independently choosen configurations and evolve with independent dynamics 
(same Hamiltonian, different noises). We may think at the clones like starting 
from the same configuration at the time t = and evolving identically (same 
Hamiltonian and same noise) until the time t = tw (obviously this process is 
not actually simulated). 

This donation procedure is different from a damage spreading procedure (see 
for example [ p5| , |26[|), where two systems starting at measured distance evolve 
whith the same noise. The damage spreading procedure was used to individ- 
uate temperatures which could be compared with equilibrium and dynamical 
transition temperatures. 
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Auto-Correlation Function 
tw=100,...,1600 N=640 T=0.5 Tc 




Figure 9: Auto-correlation functions C{tw,tw +t) vs r/tw for different tyj. We 
do not note a simple r/tw behaviour. 
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Scaling of Fluctuations 

for Auto-Correlation Functions 




Our aim here is to investigate the geometry of the phase space monitoring the 
Auto-Correlation Function (^), and the Clones- Correlation Function, defined 
by: 



QiN,t^){t) = <l/N J2 i'^^it)Mt)) > (6) 

((T e r are the spins of two different clones). 

These quantities are simply related to the Euclidean distance in phase space. 
The Auto-Correlation is related to the Euclidean distance between the con- 
figuration of each clone at the time t^ with its own configuration at the time 

t ^ trfj^ as! 

1=1, TV 

Similarly the Clones-Correlation (|^) is related to the distance between the 
clones (generated at the time t^) at the time t: 



< ^ E ('^»(*) - ^»(*))' > = 2(1 - Q(^,i„)(t)) 



i=l.N 



In Fig.^ we show the results of the measurement. We see that at first we 
have C > Q, but, after some time, this relation inverts, and we have Q > C. 

Remembering the relations of these quantities with the euclidean distances, 
it means that at first the clones go away from each others more than how much 
they drift away from the initial configuration at the time t^. But after, they 
continue their drift standing close and forgetting the initial t^ configuration. 
The simplest picture representing such a behaviour is that of a dynamics fol- 
lowing canyons or in corridors: at first the clones span the width of the channel 
and, after, they drift away along it. 

If the situation has been that of a series of independent traps (like for ex- 



ample in 1 24 1) we should see a different behaviour, probably with Q = C. Here 
we see, at least, a kind of hierarchy of traps [^ . 

In the present work we do not get the asymptotic limit of Q. We suspect 
that it goes to zero, even if the curve is very slow but we can not exclude that 
it may reach a costant value different from zero. 



4 Conclusions 

The non-equilibrium dynamics of the SK model takes place in a range of time 
that grows exponentially with the size of the system. In this region, we identify 
two distinct regimes, characterized by different scaling properties of q2{N, t) the 
average squared overlap beetween two typical configurations visited at time t. 
The quantity q2(N,t), for a system in equilibrium, represents the second mo- 
mentum of the P{q) distribution, the order parameter for the phase transition. 
In the case of a large system that starts the dynamics from a random config- 
uration, or that equivalently is abruptely cooled from high temperature to a 
subcritical one, the relevant regime is the first Out of Equilibrium Regime, dur- 
ing which the q2{N,t) scales to zero as 1/A^. In such a situation the dynamics 
is non-stationary, presenting generic aging properties and confirming a scenario 



17 



1.00 



Clones Dinamics 
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Figure 11: donation of the system at the time t^. the plot shows the Auto- 
Correlation (H) and the Clones-Correlation (||). 
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of weak ergodicity breaking. As claimed by recent analitical works ||T^, ^ |Tl|, 
the asymptotic configurations reached by an infinite SK model, present some 
similarities with the equilibrium distribution: the out of equilibrium staggered 
magnetisation equals the equilibrium one and so does the energy density 
But the configurations visited are not real equilibrium configurations and the 
system allways escapes from them, never to return. These configurations present 
a sort of hierarchical structure. A special donation procedure shows that the 
dynamics takes place following corridors or canyons and that phace space looks 
like a kind of fast flat labyrinth that the system explores always slower looking 
for the equilibrium configurations. Such a simple numerical procedure reveals 
that the spin-glass dynamics is not simply a two-well energy problem, but we 
have to consider more complex situations (see for example Q or |2^) 
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